Key-Pose Prediction in Cyclic Human Motion

In this paper we study the problem of estimating innercyclic time intervals within repetitive motion sequences of top-class swimmers in a swimming channel. Interval limits are given by temporal occurrences of key-poses, i.e. distinctive postures of the body. A key-pose is defined by means of only one or two specific features of the complete posture. It is often difficult to detect such subtle features directly. We therefore propose the following method: Given that we observe the swimmer from the side, we build a pictorial structure of poselets to robustly identify random support poses within the regular motion of a swimmer. We formulate a maximum likelihood model which predicts a key-pose given the occurrences of multiple support poses within one stroke. The maximum likelihood can be extended with prior knowledge about the temporal location of a key-pose in order to improve the prediction recall. We experimentally show that our models reliably and robustly detect key-poses with a high precision and that their performance can be improved by extending the framework with additional camera views.Comment: Accepted at WACV 2015, 8 pages, 3 figure

Activity-conditioned continuous human pose estimation for performance analysis of athletes using the example of swimming

In this paper we consider the problem of human pose estimation in real-world videos of swimmers. Swimming channels allow filming swimmers simultaneously above and below the water surface with a single stationary camera. These recordings can be used to quantitatively assess the athletes' performance. The quantitative evaluation, so far, requires manual annotations of body parts in each video frame. We therefore apply the concept of CNNs in order to automatically infer the required pose information. Starting with an off-the-shelf architecture, we develop extensions to leverage activity information - in our case the swimming style of an athlete - and the continuous nature of the video recordings. Our main contributions are threefold: (a) We apply and evaluate a fine-tuned Convolutional Pose Machine architecture as a baseline in our very challenging aquatic environment and discuss its error modes, (b) we propose an extension to input swimming style information into the fully convolutional architecture and (c) modify the architecture for continuous pose estimation in videos. With these additions we achieve reliable pose estimates with up to +16% more correct body joint detections compared to the baseline architecture.Comment: 10 pages, 9 figures, accepted at WACV 201

Low-level laser therapy/photobiomodulation in the management of side effects of chemoradiation therapy in head and neck cancer: part 2: proposed applications and treatment protocols

Purpose: There is a large body of evidence supporting the efficacy of low-level laser therapy (LLLT), more recently termed photobiomodulation (PBM) for the management of oral mucositis (OM) in patients undergoing radiotherapy for head and neck cancer (HNC). Recent advances in PBM technology, together with a better understanding of mechanisms involved and dosimetric parameters may lead to the management of a broader range of complications associated with HNC treatment. This could enhance patient adherence to cancer therapy, and improve quality of life and treatment outcomes. The mechanisms of action, dosimetric, and safety considerations for PBM have been reviewed in part 1. Part 2 discusses the head and neck treatment side effects for which PBM may prove to be effective. In addition, PBM parameters for each of these complications are suggested and future research directions are discussed. Methods: Narrative review and presentation of PBM parameters are based on current evidence and expert opinion. Results: PBM may have potential applications in the management of a broad range of side effects of (chemo)radiation therapy (CRT) in patients being treated for HNC. For OM management, optimal PBM parameters identified were as follows: wavelength, typically between 633 and 685 nm or 780–830 nm; energy density, laser or light-emitting diode (LED) output between 10 and 150 mW; dose, 2–3 J (J/cm2), and no more than 6 J/cm2 on the tissue surface treated; treatment schedule, two to three times a week up to daily; emission type, pulsed (<100 Hz); and route of delivery, intraorally and/or transcutaneously. To facilitate further studies, we propose potentially effective PBM parameters for prophylactic and therapeutic use in supportive care for dermatitis, dysphagia, dry mouth, dysgeusia, trismus, necrosis, lymphedema, and voice/speech alterations. Conclusion: PBM may have a role in supportive care for a broad range of complications associated with the treatment of HNC with CRT. The suggested PBM irradiation and dosimetric parameters, which are potentially effective for these complications, are intended to provide guidance for well-designed future studies. It is imperative that such studies include elucidating the effects of PBM on oncology treatment outcomes.National Institutes of Health (U.S.) (NIH grant R01AI050875

Low level laser therapy/photobiomodulation in the management of side effects of chemoradiation therapy in head and neck cancer: part 1: mechanisms of action, dosimetric, and safety considerations

Purpose: There is a large body of evidence supporting the efficacy of low level laser therapy (LLLT), more recently termed photobiomodulation (PBM), for the management of oral mucositis (OM) in patients undergoing radiotherapy for head and neck cancer (HNC). Recent advances in PBM technology, together with a better understanding of mechanisms involved, may expand the applications for PBM in the management of other complications associated with HNC treatment. This article (part 1) describes PBM mechanisms of action, dosimetry, and safety aspects and, in doing so, provides a basis for a companion paper (part 2) which describes the potential breadth of potential applications of PBM in the management of side-effects of (chemo)radiation therapy in patients being treated for HNC and proposes PBM parameters. Methods: This study is a narrative non-systematic review. Results: We review PBM mechanisms of action and dosimetric considerations. Virtually, all conditions modulated by PBM (e.g., ulceration, inflammation, lymphedema, pain, fibrosis, neurological and muscular injury) are thought to be involved in the pathogenesis of (chemo)radiation therapy-induced complications in patients treated for HNC. The impact of PBM on tumor behavior and tumor response to treatment has been insufficiently studied. In vitro studies assessing the effect of PBM on tumor cells report conflicting results, perhaps attributable to inconsistencies of PBM power and dose. Nonetheless, the biological bases for the broad clinical activities ascribed to PBM have also been noted to be similar to those activities and pathways associated with negative tumor behaviors and impeded response to treatment. While there are no anecdotal descriptions of poor tumor outcomes in patients treated with PBM, confirming its neutrality with respect to cancer responsiveness is a critical priority. Conclusion: Based on its therapeutic effects, PBM may have utility in a broad range of oral, oropharyngeal, facial, and neck complications of HNC treatment. Although evidence suggests that PBM using LLLT is safe in HNC patients, more research is imperative and vigilance remains warranted to detect any potential adverse effects of PBM on cancer treatment outcomes and survival.National Institutes of Health (U.S.) (grant R01AI050875

Bestimmung intrazyklischer Phasengeschwindigkeiten von Schwimmern im Schwimmkanal mittels vollautomatischer Videoanalyse

Für die Leistungsdiagnostik von Schwimmern im Spitzensport bilden Videoaufzeichnungen eine wesentlich Grundlage für die Einschätzung des Bewegungsablaufs. Während im Routinebetrieb der leistungsdiagnostischen Untersuchungen in der Regel nur qualitative Bewertungen der Bewegungsabläufe durchgeführt werden, sind quantitative Auswertungen wegen des enormen personellen Aufwands nur in Einzelfällen möglich. Eine vollautomatische, quantitative Videoanalyse mit dem Ziel, zyklische Strukturen zu erfassen und daraus kinematische Parameter abzuleiten, eröffnet neue Möglichkeiten auf dem Gebiet der Leistungsdiagnostik. Im Rahmen des BISp-Projekts "Vollautomatische zeitkontinuierliche Bestimmung intrazyklischer Phasengeschwindigkeiten von Schwimmern im Schwimmkanal einschließlich Zugfrequenz und Zuglänge" [Pro13] wird unter Berücksichtigung jüngster Entwicklungen auf dem Gebiet der Posen- und Bewegungserkennung sowie der Zeitreihenanalyse erforscht, wie sich kinematische Parameter wie Zugfrequenz, Zuglänge und intrazyklische Phasengeschwindigkeiten vollautomatisch, d.h. ohne mühsame und arbeitsintensive manuelle Auswertung, mittels softwarebasierter Auswertung bestimmen lassen